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(54) DEVICE AND METHOD FOR CONVERTING FIELD FREQUENCY 
(57)Abstract: 

PROBLEM TO BE SOLVED: To convert a field frequency with excellent 
precision even when the mobile amount of an input picture is large. 
SOLUTION: A movement estimating part 11 estimates the mobile amount in an 
input picture. A movement compensating part 12 applies a movement 
compensating processing to the input picture based on the mobile amount. A 
movement class deciding part 13 decides a movement class based on the 
output of the part 1 1 . A class tap selecting part 14 and a prediction tap selecting 
part 15 extract the pixel of a position corresponding to the movement class from 
the output of the part 12 as a class tap and a prediction tap respectively. A space 
class deciding part 16 decides a space class based on data of the class tap. A 
class deciding part 17 decides the final class based on the output of the part 16 
and the output of the part 13. A prediction coefficient selecting part 18 outputs a 
prediction coefficient corresponding to the output of the part 17. A product sum 



arithmetic part 19 generates an output picture based on data of the prediction 
tap and a prediction coefficient. 
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CLAIMS 
[Claim(s)] 

[Claim 1] The output of an amount presumption means of motions to presume 
the amount of motions in an input image, and the above-mentioned amount 
presumption means of motions is referred to. A motion compensation means to 
perform motion compensation processing to the above-mentioned input image, 
and a motion class decision means to determine a motion class based on the 
output of the above-mentioned amount presumption means of motions, A motion 
compensation means to perform motion compensation processing to the 
above-mentioned input image based on the output of the above-mentioned 
amount presumption means of motions, The 1st image logging means which 
starts the image data of a predetermined location from the output of the 
above-mentioned motion compensation means, A class decision means to 
determine the class to which it is based on the image data started by the image 
logging means of the above 1st, the pattern of the level distribution between 



space-time is detected, and each image data belongs based on the detected 
pattern, The 2nd image logging means which starts the image data of a 
predetermined location from the output of the above-mentioned motion 
compensation means, A multiplier storage means to memorize the prediction 
coefficient beforehand determined corresponding to the above-mentioned class, 
and to output the thing corresponding to the output of the above-mentioned class 
decision means from from among the memorized prediction coefficients, The 
field power converter characterized by having a data-processing means to 
perform a prediction operation based on the image data started by the image 
logging means of the above 2nd, and the prediction coefficient supplied from the 
above-mentioned multiplier storage means. 

[Claim 2] It is the field power converter characterized by the image logging 

means of the above 1st performing processing according to the output of the 

above-mentioned amount presumption means of motions in claim 1 . 

[Claim 3] It is the field power converter characterized by the image logging 

means of the above 2nd performing processing according to the output of the 

above-mentioned amount presumption means of motions in claim 1 . 

[Claim 4] It is the field power converter characterized by performing processing 

based on [ have further a motion class decision means to move based on the 

output of the above-mentioned amount presumption means of motions, and to 



determine a class in claim 1, and ] the output of the above-mentioned motion 
class decision means in the above-mentioned class decision means. 
[Claim 5] The result of the amount presumption step of motions which presumes 
the amount of motions in an input image, and the above-mentioned amount 
presumption step of motions is referred to. The motion compensation step which 
performs motion compensation processing to the above-mentioned input image, 
and the motion class decision step which determines a motion class based on 
the result of the above-mentioned amount presumption step of motions, The 
motion compensation step which performs motion compensation processing to 
the above-mentioned input image based on the result of the above-mentioned 
amount presumption step of motions, The 1st image logging step which starts 
the image data of a predetermined location from the image generated by the 
above-mentioned motion compensation step, The class decision step which 
determines the class to which it is based on the image data started by the image 
logging step of the above 1st, the pattern of the level distribution between 
space-time is detected, and each image data belongs based on the detected 
pattern, The 2nd image logging step which starts the image data of a 
predetermined location from the image generated by the above-mentioned 
motion compensation step, The multiplier storage step which memorizes the 
prediction coefficient beforehand determined corresponding to the 



above-mentioned class, and outputs the thing corresponding to the result of the 
above-mentioned class decision step from from among the memorized 
prediction coefficients, The field frequency-conversion approach characterized 
by having the data-processing step which performs a prediction operation based 
on the image data started by the image logging step of the above 2nd, and the 
prediction coefficient supplied by the above-mentioned multiplier storage step. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the field power converter and the 
conversion approach of performing image information conversion aiming at 
improvement in resolution etc. as opposed to an input image. 
[0002] 

[Description of the Prior Art] As the approach of field frequency conversion of 
changing field frequency into 60Hz from 50Hz, the motion between the fields is 
presumed and the processing which presumed and which moves and generates 
the new field between the fields using an amount is known. However, in the 



approach of starting, when motion presumption went wrong, the problem of 
influencing directly was in the processing result. Moreover, the approach of 
starting is mere interpolation processing, and cannot raise time or spatial 
resolution. 

[0003] Moreover, the applicant for this patent has proposed previously the 
approach of changing field frequency, by using the image data extracted from 
two or more fields in the original image, and generating the new field by class 
classification adaptation processing. 
[0004] 

[Problem(s) to be Solved by the Invention] However, by such approach, since 
exact class classification adaptation processing cannot be performed when 
larger than the range of image data where the amount of motions of an input 
image is extracted, the right field is ungenerable. 

[0005] Therefore, especially, the purpose of this invention is to offer the field 
power converter which can perform field frequency conversion more exactly, and 
the conversion approach, when the amount of motions of an input image is large. 
[0006] 

[Means for Solving the Problem] An amount presumption means of motions by 
which invention of claim 1 presumes the amount of motions in an input image, A 
motion compensation means to perform motion compensation processing to an 



input image with reference to the output of the amount presumption means of 
motions, A motion class decision means to determine a motion class based on 
the output of the amount presumption means of motions, A motion 
compensation means to perform motion compensation processing to an input 
image based on the output of the amount presumption means of motions, The 
1st image logging means which starts the image data of a predetermined 
location from the output of a motion compensation means, A class decision 
means to determine the class to which it is based on the image data started by 
the 1st image logging means, the pattern of the level distribution between 
space-time is detected, and each image data belongs based on the detected 
pattern, The 2nd image logging means which starts the image data of a 
predetermined location from the output of a motion compensation means, A 
multiplier storage means to memorize the prediction coefficient beforehand 
determined corresponding to the class, and to output the thing corresponding to 
the output of a class decision means from from among the memorized prediction 
coefficients, It is the field power converter characterized by having a 
data-processing means to perform a prediction operation based on the image 
data started by the 2nd image logging means, and the prediction coefficient 
supplied from a multiplier storage means. 

[0007] The amount presumption step of motions invention of claim 5 presumes 



the amount of motions in an input image to be, The motion compensation step 
which performs motion compensation processing to an input image with 
reference to the result of the amount presumption step of motions, The motion 
class decision step which determines a motion class based on the result of the 
amount presumption step of motions, The motion compensation step which 
performs motion compensation processing to an input image based on the result 
of the amount presumption step of motions, The 1st image logging step which 
starts the image data of a predetermined location from the image generated by 
the motion compensation step, The class decision step which determines the 
class to which it is based on the image data started by the 1st image logging 
step, the pattern of the level distribution between space-time is detected, and 
each image data belongs based on the detected pattern, The 2nd image logging 
step which starts the image data of a predetermined location from the image 
generated by the motion compensation step, The multiplier storage step which 
memorizes the prediction coefficient beforehand determined corresponding to 
the class, and outputs the thing corresponding to the result of a class decision 
step from from among the memorized prediction coefficients, It is the field 
frequency-conversion approach characterized by having the data-processing 
step which performs a prediction operation based on the image data started by 
the 2nd image logging step and the prediction coefficient supplied by the 



multiplier storage step. 

[0008] According to the above invention, it can face performing class 
classification adaptation processing, and the amount of motions of an input 
image can be made to reflect. 
[0009] 

[Embodiment of the Invention] Hereafter, with reference to a drawing, 1 
operation gestalt of this invention is explained suitably. An example of a 
configuration of starting mapping in 1 operation gestalt of this invention, i.e., the 
processing which changes field frequency, is shown in drawing 1 . This 
configuration performs processing which changes a 50Hz input image into a 
60Hz output image. An input image moves and the presumed section 11 is 
supplied. By approaches, such as for example, block matching, the motion 
presumption section 1 1 presumes the motion vector of the attention pixel in an 
input image, and supplies the presumed motion vector to the motion 
compensation section 12 and the motion class decision section 13. The motion 
compensation section 12 performs motion compensation processing which shifts 
the field of an input image based on the motion vector supplied. The image 
generated as a result of motion compensation processing is supplied to the class 
tap selection section 14 and the prediction tap selection section 15. 
[0010] On the other hand, with a motion vector, the information which shows the 



dependability moves to the motion class decision section 13, and it is supplied 
from the presumed section 11. The motion class decision section 13 moves 
based on the information which shows the motion vector supplied and 
dependability, and supplies the information which determined and determined 
the class and which moves and shows a class to the class tap selection section 
14, the prediction tap selection section 15, and the class decision section 17. 
The class tap selection section 14 extracts alternatively the pixel (called a class 
tap) of the predetermined location used for the classification of a space class 
with reference to a motion class, and supplies the data of the extracted class tap 
to the space class decision section 16. the data with which the space class 
decision section 16 is supplied - being based -- ADRC (Adaptive 
DynamicRange Coding) etc. -- by performing processing to include, a space 
class is determined and the information which shows the determined space 
class is supplied to the class decision section 17. 

[0011] The class decision section 17 determines a final class based on the 
information which shows the space class supplied from the space class decision 
section 16, and the information which shows the motion class which moves as 
mentioned above, and is supplied from the class decision section 13. The class 
decision section 17 supplies the information which shows the determined final 
class to the prediction coefficient selection section 18. The prediction coefficient 



selection section 18 outputs the prediction coefficient corresponding to a final 
class with reference to the output of the class decision section 17. This 
prediction coefficient is supplied to the sum-of-products operation part 19. In 
addition, the prediction coefficient selection section 18 has the memory which 
the prediction coefficient beforehand determined as mentioned later 
corresponding to the class is supplied, and holds the prediction coefficient 
supplied. 

[0012] On the other hand, the prediction tap selection section 15 extracts a 
predetermined pixel field (called a prediction tap) from the output of the motion 
compensation section 12 alternatively with reference to the motion class 
supplied from the motion class decision section 13. The data of the extracted 
prediction tap are supplied to the sum-of-products operation part 19. The 
sum-of-products operation part 19 generates the output image from which field 
frequency was changed by performing the sum-of-products operation according 
to the following formulas (1) based on the data of a prediction tap, and the 
prediction coefficient supplied from the prediction coefficient selection section 18. 
[0013] 

y=w1 xx1+w2 xx2+ .... +wn xxn (1) 

Here, they are x1 , xn. It is pixel data of each prediction tap, and they are 

w1, .., wn. It is each prediction coefficient. 



[0014] Next, actuation of the motion presumption section 11 is explained to a 
detail. The motion presumption section 11 presumes an inter-frame motion 
vector by approaches, such as for example, block matching. The outline of block 
matching is explained with reference to drawing 2 . A matching operation is 
performed between the image in the reference block B1 which consists of a mxn 
pixel in the current frame F1, the block B1 in the retrieval range S1 which 
consists of a sxt pixel set up in the past frame F2, and candidate block B-2 of 
isomorphism. That is, the difference of the pixel value of a location which 
corresponds between a reference block B1 and candidate block B-2 is taken, 
and the evaluation value about candidate block B-2 is created by processing of 
accumulating the absolute value of difference over whole block B-2. 
[0015] The motion vector corresponding to a reference block B1 is detected by 
creating such an evaluation value about all candidate blocks in the retrieval 
range S1, and determining the location of the candidate block with which an 
evaluation value serves as min as a location of the candidate block with the most 
sufficient matching. When using the block which shifted 1 pixel at a time as a 
candidate block in the retrieval range S1, the candidate block of a sxt individual 
will be dealt with in all. In addition, you may make it set up the retrieval range for 
a reference block in a current frame for the inside of a past frame. About block 
matching, it is indicated by the proposal (for example, refer to JP,54-124927,A) 



of an applicant's for this patent point at the detail. What is necessary is just to set 
up the magnitude of a reference block and the retrieval range etc. appropriately 
according to conditions, such as a property of the image which moves and is 
made into a presumed object. With 1 operation gestalt of this invention, the block 
size of a reference block is made into 3 pixels by 6 pixels, and the retrieval range 
is made into **16 pixels at a horizontal chisel, for example. 
[0016] Moreover, with 1 operation gestalt of this invention, it is the following, and 
the dependability of the motion vector presumed as mentioned above is made 
and judged. That is, when the minimum value of an evaluation value turns into 
beyond the predetermined value of for example, the 180th grade, it judges with it 
being unreliable, and let a motion vector be an invalid. When a motion vector is 
made into an invalid, 0 is outputted as a motion vector. 

[0017] In the motion compensation section 12, the class tap selection section 14, 
and the prediction tap selection section 15, the processing according to the 
mode decided by physical relationship of the pixel in an input image and the 
pixel in an output image is made. First, the mode is explained with reference to 
drawing 3 and drawing 4 . An example of the physical relationship of the pixel in 
an input image and the pixel in an output image is explained to drawing 3 . In 
drawing 3 , the direction of time amount is shown horizontally and the 
perpendicular direction within an image is shown perpendicularly. Therefore, the 



list of a vertical pixel expresses the field. Moreover, a black dot shows the pixel 

in an input image, and a white round head shows the pixel in an output image. 

Drawing 4 shows that there is two or more kinds of physical relationship between 

the pixel in an input image, and the pixel in an output image. 

[0018] Drawing 4 shows such physical relationship to a detail. Here, for every 
mode, as an example of representation, thin ink was attached and one output 
pixel was shown. When the pixel in an output image is on the field in an input 
image, there are the mode (mode 0) with which the pixel in an input image 
serves as [ the pixel in an output image ] the same location, and the mode (mode 
3) which is while the pixel in an output image is a pixel in an input image. 
Moreover, when the pixel in an output image is on the field generated between 
the fields in an input image The mode which has a pixel in an output image, and 
the pixel whose vertical location corresponds on the field in the input image 
located immediately before in time to the field concerned (mode 1), There is the 
mode (mode 2) which has a pixel in an output image and the pixel whose vertical 
location corresponds on the field in the input image located immediately after in 
time to the field concerned. 

[0019] The motion compensation section 12 performs processing which is 
different by the case (mode 0 and mode 3) where the pixel in an output image is 
on the field in an input image, and the case (mode 1 and mode 2) where it is on 



the field where the pixel in an output image is generated between the fields in an 
input image. Such processing is explained with reference to drawing 5 and 
drawing 6 . An example of the processing in the mode 0 and the mode 3 is 
shown in drawing 5 . Here, a lengthwise direction shows time amount and a 
longitudinal direction shows the horizontal location in each field, moreover, the 
field which should be generated -- a time - N -- it can set » the field - it is - field 
- (-- the case where it is in the same time amount location as N) is explained as 
an example. In this case, the location of the pixel in the input image shown with a 
square and the location of an attention pixel (two slashes which cross mutually 
show) are in agreement. 

[0020] Moreover, in drawing 5 , it writes me_x [ the motion vector presumed 
between field (N) and field (N+2) which is the field in N+2 at the time ]. In this 
case, processing only whose me_x/2, and -me_x / 2 draw near horizontally the 
field (N-1) and the field (N+1) as a motion compensation, respectively is 
performed. Thereby, in the field (N-1) and the field (N+1), a horizontal motion 
can obtain the image negated mostly seemingly. 

[0021] On the other hand, an example of the processing in the mode 1 and the 
mode 2 is shown in drawing 6 . Here, a lengthwise direction shows time amount 
and a longitudinal direction shows the horizontal location in each field, moreover, 
the field which should be generated - a time -- N - it can set - the field -- it is - 



field - (-- N) and time N+ - the case where it is located between field(s) (N+1) 
which are the field in 1 is explained as an example. In this case, it differs from 
the location of the location (two slashes which cross mutually show) of the pixel 
in the input image shown with a square, and an attention pixel. 
[0022] Also in drawing 6 , it writes me_x [ the motion vector presumed like 
drawing 5 between field (N) and field (N+2) which is the field in N+2 at the time ]. 
In this case, 3xme_x/4, me_x/4 and -me_x/4, and ************** processing are 
horizontally performed as a motion compensation, respectively in the field (N-1), 
field (N), and the field (N+1). The image the horizontal motion was seemingly 
denied mostly in the field (N-1) and the field (N+1) by such processing can be 
obtained. 

[0023] Next, processing by the motion class decision section 13 is explained. 
The motion class decision section 13 moves, as mentioned above, and the 
information which shows the dependability of a motion vector and a motion 
vector is supplied to it from the presumed section 1 1 . Based on these, a motion 
class is determined as follows. 
[0024] 

Motion class 0: A motion vector is effective, a 0 motion class 1:motion vector has 
an effective motion vector value, a less than [ 6 ] motion class 2:motion vector 
has the effective absolute value of a motion vector value, and, for the absolute 



value of a motion vector value, a more than 7 motion class 3:motion vector is an 
invalid (a motion vector value is set to 0 at this time). 

Here, when judged with the dependability of a motion vector being low, a motion 
vector is made into an invalid (as mentioned above, when the minimum value of 
the evaluation value in block matching turns into beyond a predetermined value), 
and a motion vector is confirmed when other. Moreover, the value of 6 and 7 
grades made into the reference value at the time of moving with the motion class 
1 and judging a class 2 is an example, and is not limited to this. What is 
necessary is just to make it refer to a suitable value generally in consideration of 
the magnitude (for example, horizontally **16 etc. pixels etc.) of the retrieval 
range, the property of an input image, etc. In addition, the motion class 3 is for 
avoiding that an unsuitable motion compensation is performed based on an 
unreliable motion vector. 

[0025] Next, actuation of the class tap selection section 14 and the prediction tap 
selection section 15 is explained. The class tap selection section 14 and the 
prediction tap selection section 15 move with the mode, and extract the pixel of a 
predetermined location as a class tap and a prediction tap according to a class. 
An example of the tap structure corresponding to the modes 0, 1, 2, and 3 is 
shown in drawing 7 , drawing 8 , drawing 9 , and drawing 10 . In drawing 7 - 
drawing 10 , the black dot showed the pixel extracted as a class tap or a 



prediction tap at the time of the motion classes 0 and 1 , and with a circle [ white ] 
showed the pixel extracted as a class tap or a prediction tap at the time of the 
motion classes 2 and 3. Moreover, with a circle [ of a dotted line ] showed all 
pixels other than the pixel extracted as a class tap or a prediction tap. 
[0026] An example of the tap structure in the mode 0 is shown in drawing 7 . As 
shown in drawing 7 A, it moves with the motion classes 0 and 1 , and class tap 
structure is in agreement in classes 2 and 3. That is, also in which motion class, 
two pixels [ a total of seven ] are extracted from the field after 1 field of five 
pieces from the current field, and the current field as a class tap. Moreover, as 
shown in drawing 7 B, prediction tap structure moves, and it moves with classes 
0 and 1 , and is in agreement in classes 2 and 3. That is, two pixels [ a total of 
13 ] are extracted from each field of the current field to an in front of 1 field of 
nine pieces and the current field and after 1 field as a prediction tap, respectively. 
[0027] An example of the tap structure in the mode 1 is shown in drawing 8 . In 
the case of the motion classes 0 and 1 , the pixel (respectively from [ Namely, ] 
each field of the present field to an in front of 1 field of four pieces and the 
present field and after 1 field one piece and three pieces [ a total of eight ]) of the 
location shown by the black dot in drawing 8 A is extracted as a class tap. 
Moreover, in the case of the motion classes 2 and 3, the pixel (each field after 1 
field of the present field to 4 from the present field, five pieces [ a total of eight ]) 



of the location shown with a circle [ white ] in drawing 8 A is extracted as a class 
tap. On the other hand, in the case of the motion classes 0 and 1, the pixel 
(respectively from each field of the present field to an in front of 1 field of eight 
pieces and the present field and after 1 field three pieces [ a total of 14 ]) of the 
location shown by the black dot in drawing 8 B is extracted as a prediction tap. 
Moreover, in the case of the motion classes 2 and 3, the pixel (each field after 1 
field of the present field to 8 from the present field, five pieces [ a total of 13 ]) of 
the location shown with a circle [ white ] in drawing 8 B is extracted as a 
prediction tap. 

[0028] An example of the tap structure in the mode 2 is shown in drawing 9 . As 
shown in drawing 9 A, it moves with the motion classes 0 and 1 , and class tap 
structure is in agreement in classes 2 and 3. That is, also in which motion class, 
two pixels [ a total of seven ] are extracted from the field after 1 field of five 
pieces from the current field, and the current field as a class tap. On the other 
hand, in the case of the motion classes 0 and 1 , the pixel (respectively from each 
field of the present field to an in front of 1 field of nine pieces and the present 
field and after 1 field two pieces [ a total of 13 ]) of the location shown by the 
black dot in drawing 9 B is extracted as a prediction tap. Moreover, in the case of 
the motion classes 2 and 3, the pixel (the field after 1 field of the present field to 
9 from the present field, six pieces [ a total of 15 ]) of the location shown with a 



circle [ white ] in drawing 8 B is extracted as a prediction tap. 
[0029] An example of the tap structure in the mode 3 is shown in drawing 10 . In 
the case of the motion classes 0 and 1, the pixel (respectively from [ Namely, ] 
each field of the present field to an in front of 1 field of two pieces and the 
present field and after 1 field three pieces [ a total of eight ]) of the location 
shown by the black dot in drawing 10 A is extracted as a class tap. Moreover, in 
the case of the motion classes 2 and 3, the pixel (each field of the present field to 
an in front of 1 field of six pieces and the present field and after 1 field to one 
piece [ a total of eight ]) of the location shown with a circle [ white ] in drawing 8 A 
is extracted as a class tap. On the other hand, as shown in drawing 10 B, it 
moves with the motion classes 0 and 1, and prediction tap structure is in 
agreeme nt in classes 2 and 3. That is, also in which motion class, three pixels [ a 
total of 14 ] are extracted from each field of the current field to an in front of 1 
field of eight pieces and the current field and after 1 field as a class tap, 
respectively. 

[0030] Next, calculation of the prediction coefficient used by facing for 
performing mapping learned namely, mentioned above is explained. The image 
which has the same signal format as the input image in drawing 1 moves as a 
student image, and is supplied to the presumed section 21 and the motion 
compensation section 22. The motion presumption section 21 performs the 



same 



processing as the motion presumption section 1 1 in drawing 1 . That is, 
the motion presumption section 21 presumes the motion vector of the attention 
pixel in a student image, and supplies the presumed motion vector to the motion 
compensation section 22. Moreover, with a motion vector, the motion 
presumption section 21 moves and supplies the information which shows the 
dependability to the class decision section 23. On the other hand, the motion 
compensation section 22 performs the same motion compensation processing 
as the motion compensation section 12 in drawing 1 . The image generated as a 
result of this motion compensation processing is supplied to the class tap 
selection section 24 and the prediction tap selection section 25. 
[0031] The motion class decision section 23 performs the same processing as 
the motion class decision section 13 in drawing 1 , moves, and supplies the 
information which determined and determined the class and which moves and 
shows a class to the class tap selection section 24, the prediction tap selection 
section 25, and the class decision section 27. The class tap selection section 24 
extracts the pixel of the same location as the class tap selection section 14 in 
drawing 1 as a class tap, and supplies the data of the extracted class tap to the 
space class decision section 26. By performing the same processing as the 
space class decision section 16 in drawing 1 based on the data supplied, the 
space class decision section 26 determines a space class, and supplies the 



information which shows the determined space class to the class decision 
section 27. 

[0032] By performing the same processing as the class decision section 17 in 
drawing 1 , the class decision section 27 determines a final class, and supplies 
the information which shows a final class to the matrix selection section 28. The 
matrix selection section 28 chooses the matrix corresponding to a final class, 
and supplies the data concerning the selected matrix to the matrix adder unit 29. 
[0033] On the other hand, the prediction tap selection section 25 extracts the 
pixel of the same location as the prediction tap selection section 15 in drawing 1 
as a prediction tap, and supplies the data of the extracted prediction tap to the 
matrix adder unit 29. The image of the still more nearly same signal format as 
the output image in drawing 1 is supplied to the matrix adder unit 29 as a teacher 
image. In the matrix adder unit 29, the data of a normal equation are generated 
by performing processing which adds the result of an operation based on the 
data and the teacher image of a prediction tap to the data supplied from the 
matrix selection section 28. The data of a normal equation are supplied to the 
multiplier decision section 30 from the matrix adder unit 29. The multiplier 
decision section 30 computes a prediction coefficient by performing the 
operation which solves a normal equation. The computed prediction coefficient 
is once memorized by the memory which is not illustrated, for example, and 



becomes possible [ being used in data processing mentioned above with 
reference to drawing 1 by the approach of being loaded to the memory of 
prediction coefficient selection circles in drawing 1 ]. 

[0034] Next, the operation for computing a prediction coefficient is explained. It 
sets at an above-mentioned ceremony (1), and they are prediction coefficients 

W 1 wn before study. It is an undetermined coefficient. Study is performed by 

inputting two or more teacher images for every class. When writing m [ the 
number of classes of a teacher image ], the following formulas (2) are set up 
from a formula (1). 
[0035] 

yk =w1 xxk1+w2 xxk2+ .... +wn xxkn (2) 
(k= 1, 2, m) 

In m>n, they are prediction coefficients w1 wn. Since it is not decided that it 

will be a meaning, it is the element ek of the error vector e. It is determined that a 
prediction coefficient makes into min the error vector e which defines by the 
following formulas (3) and is defined by the formula (4). That is, a prediction 
coefficient is set to a meaning with the so-called least square method. 
[0036] 

ek =yk- {w1 xxk1+w2 xxk2+....+wn xxkn} (3) 
(k= 1,2, .... m) 



[0037] 
[Equation 1] 

e 2 = X>* (4) 

[0038] e2 of a formula (4) As the practical count approach for asking for the 
prediction coefficient made into min, it is e2. It is each prediction coefficient wi so 
that a partial differential may be carried out with a prediction coefficient wi (1 i= 
two ....) (formula (5)) and a partial-differential value may be set to 0 about each 
value of i. What is necessary is just to set. 
[0039] 

[Equation 2] 

a„2 « de t ™ 

{r--£*(-i>. t -£2jc J( -., <» 

[0040] A formula (5) to each prediction coefficient wi The concrete procedure to 
define is explained. They are Xji and Yi as shown in a formula (6) and (7). If a 
definition is given, a formula (5) can be written to the form of the determinant of a 
formula (8). 
[0041] 
[Equation 3] 



[0042] 
[Equation 4] 

m 

[0043] 
[Equation 5] 



























X n2 













(8) 



[0044] Generally an equation (8) is called a normal equation. The matrix adder 
unit 29 computes the parameter in a normal equation (8). The multiplier decision 

section 30 computes a prediction coefficient wi (i= 1, 2 n) by sweeping out 

based on the computed parameter and solving a normal equation (8) according 
to general matrix solution methods, such as law. 

[0045] Although made with 1 operation gestalt of this invention mentioned above 
as [ reflect / in class tap selection, prediction tap selection, and the class 
classification in the class decision circuit 17 / the motion vector obtained as a 
processing result by the motion presumption section 1 1 ], reflection of the motion 
vector to field frequency conversion processing carries out, and a way is not 



limited to this. For example, it is possible to raise the conversion engine 
performance to some extent to field frequency conversion by the configuration 
which uses a motion vector only for a motion compensation, the configuration 
which uses a motion vector for selection of a motion compensation, a class tap, 
and/or a prediction tap, the configuration which uses a motion vector for a 
motion compensation and a class classification, when a motion of an input 
image is large. 

[0046] It is thought that circuitry is enlarged, although the conversion engine 
performance when a motion of an input image is large becomes good so that a 
motion vector may be reflected in actuation of general more many components 
and it constitutes, therefore, **** for a configuration which suits according to 
conditions, such as the conversion engine performance and circuit scale which 
are required of equipment on the occasion of application of this invention, and 
cost, -- what is necessary is just to make it like 

[0047] The various deformation and the application within limits which there are 
not and do not deviate from the main point of this invention are possible for this 
invention what is limited to 1 operation gestalt of this invention mentioned above. 
[0048] 

[Effect of the Invention] According to this invention, field frequency conversion is 
made by applying class classification adaptation processing to the image by 



which the motion compensation was carried out based on the amount of motions 
in an input image. For this reason, when the amount of motions is large, the 
precision of transform processing can be raised. 

[0049] If it is made to perform processing according to the amount of motions in 
case the image data especially used for the operation in class classification 
adaptation processing is started, the precision of transform processing can be 
raised more. 

[0050] Moreover, if it is made to perform a class classification also in 
consideration of the amount of motions in addition to the pattern of level 
distribution of the image data between space-time, the precision of transform 
processing can be raised more. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is a block diagram for explaining the configuration concerning field 
frequency conversion processing in 1 operation gestalt of this invention. 
fDrawing 2] It is an approximate line Fig. for explaining block matching. 
fDrawing 3] It is an approximate line Fig. for explaining the physical relationship 



of the pixel in an input image, and the pixel in an output image. 

[Drawing 4] It is an approximate line Fig. for explaining the mode. 

[Drawing 5] It is an approximate line Fig. for explaining the motion compensation 

processing in the mode 0 and the mode 3. 

[Drawing 6] It is an approximate line Fig. for explaining the motion compensation 
processing in the mode 1 and the mode 2. 

fDrawing 7] It is an approximate line Fig. for explaining the tap structure in the 
mode 0. 

[Drawing 8] It is an approximate line Fig. for explaining the tap structure in the 
mode 1 . 

fDrawing 9] It is an approximate line Fig. for explaining the tap structure in the 
mode 2. 

[Drawing 10] It is an approximate line Fig. for explaining the tap structure in the 
mode 3. 

fDrawing 11] It is a block diagram for explaining processing concerning study in 

I operation gestalt of this invention. 
[Description of Notations] 

II [ ... Motion compensation section ] ... The motion presumption section, 12 ... 
The motion compensation section, 21 ... The motion presumption section, 22 



